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DESCRIPTION 

THREE-DIMENSIONAL IMAGE DISPLAY DEVICE, THREE-DIMENSIONAL 
IMAGE DISPLAY METHOD, AND COMPUTER PROGRAM PRODUCT FOR 
5 THREE-DIMENSIONAL IMAGE DISPLAY 

TECHNICAL FIELD 

The present invention relates to a three-dimensional 

image display device, a method of displaying a three- 
10 dimensional image, and a computer program product for 

displaying a three-dimensional image, according to which a 

parallax information is displayed. 

This application is based upon and claims the benefit 

of priority from the prior Japanese Patent Application No. 
15 2005-283478, filed on Sep. 29, 2005; the entire contents of 

which are incorporated herein by reference. 

BACKGROUND ART 

A naked-eye type three-dimensional image display 

20 device, in which the parallax information is spatially cut 
in a horizontal direction and presented, has been known. 
An observer can recognize a three-dimensional image by 
observing the parallax information according to his/her 
position, further, to a position of his/her eyes. 

25 Many of the three-dimensional image display devices 

are specifically structured by a combination of a flat 
panel display (FPD) such as a liquid crystal display (LCD) 
and a plasma display panel (PDP) , and an optical plate 
represented by, a . lens array and a pinhole array, or the 

30 like. 

In the case of the lens, .a ray emitted from a point in 
a pixel of the FPD exits as a substantially parallel light, 
when the FPD is positioned substantially at a focal 
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distance of the lens. Since a pixel has a limited size, 
the ray emitted from the pixel is incident on a certain 
range. In the case of the pinhole, the ray emitted from a 
pixel goes through the pinhole, whereby a direction, to 
5 which the ray exits, is limited. By making the direction 
to which the ray exits and the direction in which image 
information to be displayed on the pixel from which the ray 
is emitted is obtained substantially conform to each other, 
an appropriate image can be seen according to the position 
10 of the observer, further to the position of the eyes of the 
observer. Then, the image is recognized as the three- 
dimensional image. The lens and the pinhole are called as 
an exit pupil. 

In the structure of such naked-eye type three- 
15 dimensional image display device, it is required to relate 
a plurality of pixels for displaying two-dimensional image 
for displaying the parallax information, that is, an 
elemental image, to one pixel for displaying three- 
dimensional image (lens and pinhole) . 
20 Since the number of pixels of the FPD is limited, 

there is a trade-off relation, that is, if the parallax 
information is increased, definition of the three- 
dimensional image is deteriorated, whereas if the 
definition of the three-dimensional image is improved, 
25 parallax number is decreased. In order to restrain the 
deterioration of the definition of the three-dimensional 
image and of the parallax number, a method to present the 
parallax information only in the horizontal direction, has 
been known. The three-dimensional image display device 
30 thus presenting the parallax information only in the 

horizontal direction is called as a horizontal parallax 
type three-dimensional image display device. 

On the other hand, when only a limited number of 
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pixels for displaying the two-dimensional image are 
assigned to one pixel (lens and pinhole) for displaying the 
three-dimensional image, parallax information can be 
presented only in a limited range, in other words, a range 
5 in which the three-dimensional image can be observed is 

limited. In order to solve such a problem, there has been 
a method of performing tracking of the position of the 
observer, thereby shifting a group of pixels for displaying 
the two-dimensional image assigned to the pixel for 
10 displaying three-dimensional image, namely, a method of 
shifting a display position of the elemental image (for 
example, refer to Japanese Patent Application Laid-Open No. 
H09-233500) . 

15 DISCLOSURE OF INVENTION 

However, the horizontal parallax type three- 
dimensional image display device is easily affected by 
position change of the observer, when the exit pupil is 
inclined from the vertical direction of the display screen. 

20 Specifically, if the observer moves, the viewing zone in 

which the three-dimensional image is observed is shifted in 
the horizontal direction of the display screen. This 
problem is especially obvious when the horizontal parallax 
type three-dimensional image display device is set such 

25 that a display surface thereof is horizontal, that is, in 
the so-called flatbed display. In the flatbed display, y 
coordinate is affected by the position and sitting height 
of the observer, and is easy to change as compared to that 
in a vertically-set device. 

30 Further, a positioning of the two-dimensional image 

display device and the optical plate is required to have a 
sufficient accuracy, for ^he positioning relates to a 
visual region of the three-dimensional image display device. 
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In the horizontal parallax type devices, the parallax 
information is sometimes disposed by sub-pixel pitch of the 
FPD in order to increase the horizontal parallax number. 
In this case, the parallax information is shifted by one 
5 with shift by sub-pixel width (approximately 50 . jam) . When 
the exit pupil is inclined from the vertical direction, an 
angle of depression, that is, y-coordinate is required to 
be tentatively defined for the setting of the visual region. 
Hence, the positioning becomes more difficult.. 
10 According to one aspect of the present invention, a 

three-dimensional image display device includes a two- 
dimensional image display screen having color filters in 
which each color is disposed on sub-pixels obtained by 
dividing one pixel in a vertical direction and same color 
15 is disposed on each column of sub-pixels; an optical plate 
having an exit pupil, the exit pupil being provided for 
making a viewing zone different for each pixel and having a 
longitudinal axis disposed as to be inclined from a 
vertical direction of the two-dimensional image display 
20 screen at a degree (9) (9*0, -45° < 9 < 45°), the viewing 
zone being a region in which parallax information displayed 
on the two-dimensional image display screen is. observed; 
and a viewing zone adjusting unit that adjusts the viewing 
zone by shifting the viewing zone in a horizontal direction 
25 of the two-dimensional image display screen by shifting the 
parallax information disposed on each pixel of the two- 
dimensional image display screen in the vertical direction 
by pixel. 

According to another aspect of the present invention, 
30 a method of displaying a three-dimensional image in a 

three-dimensional image display device which has a two- 
dimensional image display screen having a color filter in 
which each color is disposed on sub-pixels obtained by 
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dividing one pixel in a vertical direction and same color . 
is disposed on each column of sub-pixels, and an optical 
plate having an exit pupil, the exit pupil being provided 
for making al 

5 viewing zone different for each pixel and having a 
longitudinal axis disposed as to be inclined from a 
vertical direction of the two-dimensional image display 
screen at a degree (9) (9*0, -45° < 9 < 45°), the viewing 
zone being a region in which parallax information displayed 

10 on the two-dimensional image display screen is observed, 
includes shifting the viewing zone in a horizontal 
direction of the two-dimensional image display screen by 
shifting the parallax information disposed on each pixel of 
'the two-dimensional image display screen in the vertical 

15 direction by pixel. 

A computer program product according to still another 
aspect of the present invention causes a computer to 
perform the method according to the present invention. 

20 BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 shows an entire structure of a three- 
dimensional image display device according to a first 
embodiment of the present invention; 

FIG. 2 shows a two-dimensional image display screen of 
25 the three-dimensional image display device; 

FIG. 3 shows an inclined line of an optical plate 
relative to a pixel of the two-dimensional image display 
screen of FIG. 2; 

FIG. 4 is a block diagram showing a functional 
30 structure of a display image processing unit shown in FIG. 

i; 

FIG. 5 shows an arrangement of parallax information 
disposed by a device information holding unit shown in FIG. 
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FIG. 6 is an enlarged view of one elemental image in 
the parallax information shown in FIG. 5; 

FIGS, 7A and 7B schematically show a relationship 
5 between a disposing position of the elemental image and a 
viewing zone; 

FIG. 8 shows shifting of the elemental image array in 
the horizontal direction; 

FIG. 9 shows a result of shifting of the elemental 
10 image array shown in FIG . 6 by one pixel in the vertical 
direction ; 

FIG. 10 shows a result of further shifting of the 
elemental image array shown in FIG. 9 by one pixel in the 
vertical direction; 
15 FIG. 11 shows a result of shifting of the elemental 

image array by three pixels; 

FIG. 12 shows a result of shifting of the elemental 
image array by four pixels; 

FIG. 13 is a flowchart showing a position displacement 
20 correction process by the three-dimensional image display 
device according to the first embodiment; 

FIG. 14 schematically shows a shift o.f the viewing 
zone according to a movement of the observer in y- 
direction ; 

25 FIG. 15 shows a flatbed- type three-dimensional image 

display device; 

FIG. 16 is a diagram for explaining the position 
displacement correction process in an integral imaging 
system; 

30 FIG. 17 is a diagram for explaining the position 

displacement correction process in a multi-lens type 
system; 

FIG. 18 is a diagram of a- hardware structure of the 
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display image processing unit of the three-dimensional 
image display device according to the first embodiment; and 

FIG. 19 is a view showing a three-dimensional image 
display device according to a second embodiment. 

5 

BEST MODE (S) FOR CARRYING OUT THE INVENTION 

Hereinafter, a three-dimensional image display device, 
a three-dimensional image display method, and- a computer 
program product for three-dimensional image display 

10 according to the present invention will be described in 
detail with reference to the drawings. The present 
invention is not limited to the embodiment. 

FIG. 1 is a view showing an entire structure of a 
three-dimensional image display device 10 according to a 

15 first embodiment. The three-dimensional image display 

device 10 includes a display image processing unit 100 that 
controls an arrangement of a parallax information, a two- 
dimensional image display screen 200 that displays the 
parallax information, and an optical plate 300 that 

20 controls a ray from the two-dimensional image display 

screen 200. The two-dimensional image display screen 200 
includes a liquid crystal layer 201 and a color filter 
layer 202 . 

The optical plate 300 in this embodiment is a 
25 lenticular sheet. A longitudinal axis 302 of the optical 

plate 300 is inclined to left at arctan (1/4) relative to a 
vertical direction of the two-dimensional image display 
screen 200. The two-dimensional image display screen 200 
displays parallax information according to the inclination 
30 thereof. 

It is only necessary that the longitudinal axis 302 of 
the optical plate 300 is inclined at a predetermined degree 
(8 ^ 0, -45° < 0 < 45°) relative to the vertical direction 
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of the two-dimensional image display screen 200, and a 
degree of the inclination is not limited to that of the 
embodiment . 

The display image processing unit 100 adjusts a 
5 viewing zone in which the parallax information displayed on . 
the two-dimensional image display screen 200 is observed, 
by changing a disposing position of the parallax 
information displayed on the two-dimensional image display 
screen 200. 

10 Meanwhile, in this embodiment, a depth direction, in 

which an observer side is positive, is z-direction. A 
horizontal direction of the two-dimensional image display 
screen 200, in which a right side of the observer is 
positive, is x-direction. A vertical direction of the two- 

15 dimensional image display screen 200, in which an upper 
side is positive, is y-direction. 

FIG. 2 shows the two-dimensional image display screen 
200, on which square pixels are disposed in array. Each of 
the pixels includes sub-pixels 231, 232, and 233, which are 

20 R (red) , G (green) , and B (blue) , respectively. 

Each of the sub-pixels 231, 232, and 233, which are R 
(red) , G (green) , and B (blue) , respectively, is repeatedly 
disposed along the horizontal direction in this order. In. 
the vertical direction, every column is composed of the 

25 sub-pixels of same color. The R (red), G (green), and B 
(blue) sub-pixels are realized by a proper disposition of 
the color filter 202 on the display screen. 

Herein, the reason for inclining the longitudinal axis 
of the optical plate 300 at 0 degree (*0) relative to the 

30 sub-pixel column will be described. When the three sub- 
pixels R, G, and B, which are disposed horizontally, are 
treated as one pixel and t;he optical plate 300 is inclined, 
in order to improve horizontal definition, horizontal 
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definition H and vertical definition V of a displayed 
three-dimensional image are represented by a following 
formulae (1) : 

H = Horiginal x 3 + N + a 
5 V = Voriginal -i- 3 x a (1) 

Herein, Horiginal represents the horizontal definition 
of the two-dimensional image display screen 200 , whereas . 
Voriginal represents the vertical definition of the two- 
dimensional image display screen 200. Further, N 
10 represents a parallax number and "a" represents a ratio of 
the vertical definition assigned to the horizontal 
definition as a result of the inclination of the optical 
plate 300. 

In order to maintain the ratio of the horizontal 
15 definition Horiginal to the vertical definition Voriginal 
of the two-dimensional image display screen 200 , also in 
the three-dimensional image display device 10 , Horiginal 
and Voriginal are required to satisfy a following formula 
(2): 

20 Horiginal : Voriginal 

- (Horiginal x 3 ^ N + a) : (Voriginal -j- 3 x a) (2) 
A formula (3) is derived from the formula (2) , and N is 
represented by a formula (4) : 

3/ (N-a) = a/3 (3) 
25 N = (3/a) 2 (4) 

Next, a principle of the assignment of the vertical 
definition to the horizontal definition by the inclination 
of the optical plate will be described. FIG.. 3 shows an 
inclined line 310 of the optical plate 300 relative to a 
30 pixel 230 of the two-dimensional image display screen 200. 
The inclined line 310 shown in FIG. 3 includes three 
inclined lines having different degrees 0. A region 
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corresponding to the inclined line 310 in FIG. 3 is 
observed by one eye through one of exit pupils sequentially 
disposed in a substantially vertical direction of the 
optical plate 300 , a focus of which conforms to the two- 
5 dimensional image display screen 200. When a position of 
the observer who observes the three-dimensional image 
displayed on the three-dimensional image display device, 
that is, a viewing position, is moved, the region indicated 
by the reference numeral 310 shifts in the horizontal 

10 direction accordingly. 

When the exit pupils of the optical plate 300 are 
sequentially disposed in the vertical direction in the same 
way as the above-described pixels, as in the conventional 
case, a pixel, a center of which is observed through one of 

15 the exit pupils of the optical plate 300 (the center of 
which conforms to the region indicated by the reference 
numeral 310) is either all of the pixels on one column or 
none, so that a switching period of two states by the shift 
of the region indicated by the reference numeral 310 in 

20 accordance with the move of the observer, conforms to a 
horizontal width of the sub-pixel. 

On the other hand, when the number of pixels, the 
center of which conforms to the region indicated by the 
reference numeral 310, decreases and the region indicated 

25 by the reference numeral 310 moves in accordance with the 
move of the observer due to the inclination of the optical 
plate 300, a period in which the pixel, the center of which 
conforms to the region, appears becomes shorter than the 
horizontal width of the sub-pixel. Further, when the 

30 center of the pixel is selected, there is necessarily a 
non-display portion, which is a boundary portion of the 
horizontally adjacent sub-pixels in the region indicated by 
the reference numeral 310. 
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In FIG. 3, an example in which the optical plate 300 
is inclined at a rate of four, five, and six sub-pixels in 
the vertical direction per three sub-pixels in the 
horizontal direction is shown. when the optical plate 300 
5 is inclined at the rate of four sub-pixels, five sub-pixels, 
and six sub-pixels in the vertical direction per three sub- 
pixels in the horizontal direction, a positional 
relationship between the region indicated by the reference 
numeral 310 and the pixel is identical every three sub- 
10 pixels, every four sub-pixels, and every other sub-pixels, 
respectively. That is, the number of the pixels having the 
same relative position relative to the region indicated by 
the reference numeral 310 (i.e., the pixels, whose observed 
portion is identical with each other, when observed through 
15 one of the exit pupils sequentially disposed on the 

substantially vertical direction) decreases to a quarter, a 
fifth part, and a half, respectively. On the other hand, 
in the horizontal direction, the pixels the center of which 
. conforms to the region indicated by the reference numeral 
20 310 appears in a period of a quarter the sub-pixel width, a 
fifth part of the sub-pixel width, and a half the sub-pixel 
width as compared with the period of the pixels in the 
optical plate which is perpendicular to the pixels. In 
other words, the horizontal definition increases four times, 
25 five times, and twice, respectively. 

When the parallax information is divided by sub-pixel 
pitch, a form of the sub-pixel affects a degree of 
distribution of the parallax information. A liquid crystal 
display, for example, used as the two-dimensional image 
30 display device, is designed such that three RGB sub-pixels 
form one square pixel. Further, in a design for displaying 
numerous vertical straight lines such as characters, a 
color filter of vertical stripe arrangement is "frequently 
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used. Therefore, the form of the sub-pixel here is set to 
have a ratio of vertical length: horizontal length =3: 1, 
as shown in FIG. 3. 

When three sub-pixels dispersed in different three 
5 columns instead of three adjacent sub-pixels in the same 
row in the horizontal direction, are treated as one pixel, 
in order to improve the horizontal definition in the three- 
dimensional image display device, inclination G of the 
optical plate is defined by a formula (5) : 

10 0 = arctan (1/n) (5) 

In the formula (5) , n is an optional integer. The period, 
in which the pixel the center of which conforms to the 
region indicated by the reference numeral 310 appears, 
becomes 1/n of the sub-pixel width. Thereby, the 

15 horizontal definition per sub-pixel improves by n times, 
and three RGB sub-pixels adjacent to each other in the 
horizontal direction, the centers of which conform to the 
region indicated by the reference numeral 310 by the 1/n 
period (which do not conform in the vertical direction) , 

20 form one pixel (triplet) . Therefore, a ratio "a" of the 
vertical definition assigned to the horizontal definition 
is given by a formula (6) : 

a = 3/n (6) 
In other words, when the three-dimensional image is 

25 displayed, an observable positions of the RGB sub-pixels of 
the triplet are subtly shifted (the centers of the three 
RGP sub-pixels and the region indicated by the reference 
. numeral 310 do not conform one another at the same moment) . 
Actually, even in a state in which the region indicated by 

30 the^ reference numeral 310 and the centers of the pixels do 
not conform, a part of the pixels is visually recognized 
through the exit pupil, so that a region in which the 
substantially conformed RGB sub-pixels are seen at the same 
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moment, exists. Therefore, in the case of FIG. 3,0= 
arctan (1/4), arctan (1/5), and arctan (1/6), and the ratio 
"a" of the vertical definition assigned to the horizontal 
definition becomes a = 3/4, 3/5 and 1/2, respectively. 
5 Therefore, by satisfying the relationship between n 

and N so as to satisfy the above-described formula (4) , as 
well as making the optical plate incline according to the 
formula (5) , deterioration ratios of the definition in the 
horizontal and vertical directions can be conformed to each 
10 other. That is, N and n are designed so as to satisfy a 
following formula (7) : 

N = n 2 (7) 
FIG. 4 is a block diagram of the functional structure 
of the display image processing unit 100. The display 
15 image processing unit 100 includes a parallax information 

•preparing unit 101, a parallax information holding unit 102, 
a device information holding unit 104, a parallax 
information disposing unit 110, a viewing position 
displacement detecting unit 120, an adjustment information 
20 holding unit 122, an adjustment information obtaining unit 
124, a shift amount determining unit 130, a shift direction 
determining unit 132, an elemental image array shifting 
unit 134, and a surplus portion processing unit 140. 

The parallax information preparing unit 101 prepares 
25 parallax information. Specifically, the parallax 

information preparing unit 101 prepares the parallax 
information, a size of which is larger than a screen size 
of the two-dimensional image display screen 200. The 
parallax information holding unit 102 holds the parallax 
30 information prepared by the parallax information preparing 
unit 101. The device information holding unit 104 holds 
device information. As used herein, the device information 
is intended to mean information about the two-dimensional 
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image display screen 200 and the optical plate 300, and 
specifically, is information about the screen size, a color 
alignment of the sub-pixels, and the like. 

The parallax information disposing unit 110 disposes 
5 the parallax information held by the parallax information 
holding unit 102 on each of the pixels on the two- 
dimensional image display screen 200. At this moment, the 
parallax information disposing unit 110 determines the 
disposing position of each of the parallax information, 
10 based on the device information held by the device 
information holding unit 104. 

FIG. 5 shows parallax information 400 disposed 
according to the device information held by the device 
information holding unit 104. The parallax information 
15 shown in FIG. 4 includes sixteen parallax informations in 
total from a first parallax information to a sixteenth 
parallax information. Numerals represented in each of the 
pixels indicate the number of the parallax information. 

As shown in FIG. 4, the parallax informations having a 
20 same reference numeral are disposed on positions 
corresponding to an inclination degree (0) of the 
longitudinal axis 302 of the optical plate 300. For 
example, the first parallax informations are disposed along 
an inclined line 312 inclined at the inclination degree 0. 
25 Further, the fourth parallax informations are disposed 
along an inclined line 314 inclined at the inclination 
degree 0. 

FIG. 6 is an enlarged view showing one elemental image 
410. of the parallax information 400 shown in FIG. 5. The 
30 elemental image 410 is an assembly of plural sub-pixels for 
displaying the parallax information corresponding to one 
pixel for displaying the three-dimensional image. The 
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elemental image 410 of the first embodiment includes 
fifteen pixels along the horizontal direction and four 
pixels along the vertical direction. Further, a boundary 
position along the vertical direction is shifted to right 
5 by one sub-pixel as the boundary goes downwards in the 
vertical direction, and the elemental image 410 is a 
substantially parallelogram-shape. 

The viewing position displacement detecting unit 120 
detects displacement between the viewing position, which is 

10 a position of the observer supposed in the three- 
dimensional image display device 10 in advance and an 
actual position of the observer, that is, viewing position 
displacement. Further the viewing position displacement 
detecting unit 120 detects a degree of the viewing position 

15 displacement. 

Specifically, the viewing position displacement 
detecting unit 120 detects an x-coordinate of a position of 
the head of the observer by image recognition, and performs 
tracking. Further, when thus obtained x-coordinate does 

20 not conform to the x-coordinate of the assumed viewing 

position, the viewing position displacement detecting unit 
120 detects this as the position displacement. Further, 
the viewing position displacement detecting unit 120 
detects the displacement as a viewing position displacement 

25 amount in the x-direction. Further, the viewing position 
displacement detecting unit 120 also detects the viewing 
position displacement and the viewing position displacement 
amount in the y-direction. 

Meanwhile, when the three-dimensional image display 

30 device 10 is. set vertically, the viewing position 

displacement in the y-direction does not matter. Thus, in 
this case, only the viewing position displacement and the 
viewing position displacement amount in the x-direction may 
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be detected. Further, when the three-dimensional image 
display device 10 is a flatbed display, pnly the viewing 
position displacement and the viewing position displacement 
amount in the y-direction may be detected. 
5 The adjustment information holding unit 122 holds 

adjustment information. The adjustment information is, for 
example, an optical plate position displacement amount 
indicating a degree of the displacement of a set degree of 
the optical plate 300 during the use of the three- 

10 dimensional image display device 10, and of an attaching 

position, generated when the . optical plate 300 is attached 
to the two-dimensional image display screen 200. The 
adjustment information obtaining unit 124 obtains the 
adjustment information input by a user, and makes the 

15 adjustment information holding unit 122 hold the same. 

The three-dimensional display device 10 according to 
the first embodiment can shift the viewing zone in the 
horizontal direction of the two-dimensional image display 
screen 200 according to the viewing position displacement 

20 and the adjustment information, by adjusting the disposing 
position of the parallax information. Hereinafter, the 
function and structure for this will be described. 

The shift amount determining unit 130 determines an 
amount of shifting the elemental image array, based on the 

25 viewing position displacement amount detected by the 

viewing position displacement detecting unit 120, and the 
adjustment information held by the adjustment information 
holding unit 122, Herein, a process of the shift amount 
determining unit 130 is described in detail, with reference 

30 to FIGS. 7A and 7B. FIGS. 7A and 7B illustrate a 
relationship between the disposing position of the 
elemental image array and. the viewing zone. 

For example, the region in which the elemental image 
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arrays disposed on the disposing positions 210, 212, and 
214 are observed is a viewing zone 512. Further, the 
region in which the elemental image arrays disposed on the 
disposing positions 220, 222, and 224, which moved in the 
5 z-direction from the disposing positions 210, 212, and 214, 
respectively, are observed is a viewing zone 514. 

That is, when the position of the head of the observer 
moves from a position 510 to a position 520, the viewing 
zone can be turned to a direction of the observer while 

10 holding a vision of the three-dimensional image, by 

shifting the disposing position of the elemental image 
array in the x-direction according to a move amount of the 
observer, while maintaining disposition of each parallax 
information in the elemental image arrays. 

15 More specifically, when a gap between the two- 

dimensional image display screen 200 and the optical plate 
300 is represented by w g" and a visual distance of the 
observer is represented by "L," a shift amount (xe) of the 
elemental image array for making the viewing zone follow 

20 the observer who moved by +xl in the x-direction is 
represented by a formula (8) : 

xe - -(g/L) x xl (8) 
In other words, it is only necessary that the elemental 
image array is shifted by the shift amount (xe) in the x- 

25 direction. The shift amount determining unit 130 

determines the shift amount (xe) from the formula (8) by 
using the position displacement amount detected by the 
viewing position displacement detecting unit 120, that is, 
an amount xl . 

30 The shift direction determining unit 132 determines a 

direction to which the elemental image array is shifted, 
based on the shift amount . determined by the shift amount 
determining unit 130. Herein, a process of the shift 
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direction determining unit . 132 is described in detail, with 
reference to FIG. 8. FIG. 8 shows shifting of the 
elemental image array in the horizontal direction. Since 
the image information can be treated only by pixel 
5 (triplet) , which is a minimum unit of the shift, when 
shifting the elemental image array in the horizontal 
direction. 

For example, suppose that the elemental image is 
mapped on the two-dimensional image display screen 200, as 
10 shown in FIG. 5. Further, sub-pixel pitch of the two- 
dimensional image display screen 200 is set to xsp. The 
displacement degree (0) of the optical plate 300 relative 
to the vertical direction of an edge line of a lens is 
defined by a formula (9) : 
15 9 - atan (1/n) (9) 

where n is an optional integer. 

Under the above-described condition, an interval xp in 
which the. parallax information is presented with the visual 
distance (L) is represented by a formula (10): 
20 xp = xsp x 3/n x L/g (10) 

The minimum value of the shift amount xs of a visual 
region, when the elemental image is shifted by pixel is 
represented by a formula (11) : 

xs = xsp x 3 x L/g = xp x n (11) 
25 Since n is an optional integer, it is found from the 

formula (11) that the elemental image array can be shifted 
only by unit larger than the interval xp unit in which the 
parallax information is presented. 

For example, when a WUXGA panel of 15.4 inches is used, 
30 the sub-pixel pitch xsp is set to 57.5 jam, g = 1.334 mm, 
and L = 400 mm, and mapping of the elemental image 410 is 
as shown in FIG. 6, the interval xp in which the parallax 
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information is presented is 12.93 mm, from the formula (10). 

On the other hand, the shift amount of the visual 
region is 51.72 mm at the minimum, which is larger than the 
interval xp, when the elemental image 410 is shifted in the 
5 horizontal direction by pixel pitch, according to the 

formula (11) . In other words, when the observer moves in 
the x-direction, the visual region follows the observer 
after moving by approximately 5 cm in the horizontal 
direction, so that it is recognized as flipping. 

10 By shifting the elemental image array by pixel in the 

vertical direction of the two-dimensional image display 
screen 200, a similar shift of the visual region as the 
shift by one sub-pixel in the horizontal direction becomes 
possible. Hereinafter, the shift in the vertical direction 

.15 will be described with reference to FIGS. 9 to 12 . 

FIG. 9 shows a result of shifting of the elemental 
image array shown in FIG. 6 by one pixel in the vertical 
direction. In FIG. 6, the first parallax informations are 
disposed on the inclined line 312. On the other hand, 

20 after the array is shifted by one pixel in the vertical 
direction, as shown in FIG. 9, the second parallax 
informations are disposed on the inclined line 312. In 
brief, by shifting the elemental image array by one pixel 
in the vertical direction, a disposition similar to that in 

25 which the elemental image array is shifted by one parallax 
information in the horizontal direction is achieved. 

FIG. 10 shows a result of further shifting of the 
elemental image array shown in FIG. 9 by one pixel in the 
vertical direction. In other words, FIG. 10 shows a result 

30 of shifting of the elemental image array shown in FIG. 6 by 
two pixels. In FIG. 10, the third parallax informations 
are disposed on the inclined line 312. 

FIG. 11 shows a result of shifting of the elemental 
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image array by three pixels. FIG . 12 shows a result of 
shifting of the elemental image array by four pixels. As 
is found by comparing FIGS. 11 and 8, the parallax 
informations disposed on the inclined line 312 after the 
5 elemental image array is shifted by four pixels in the 

vertical direction, and the parallax informations disposed 
on the inclined line 312 after the array is shifted by one 
pixel in the horizontal direction are both the fifth 
parallax informations. 

10 In this manner, the shift by four pixels in the 

vertical direction corresponds to the shift by one pixel in 
the horizontal direction. In other words, the shift by a 
quarter pixel in the horizontal direction is realized by 
the shift by one pixel in the vertical direction. 

15 For example, as described above, when the elemental 

image array is shifted by one pixel in the horizontal 
direction, the visual region is shifted by 51.72 mm. 
However, when the array is shifted by one. pixel in the 
vertical direction, the viewing zone can be shifted by 

20 pitch of. 51.72 mm/4 mm. The shift amount of the visual 
region when the elemental image array is shifted by one 
pixel in the vertical direction equals to the interval (xp) 
represented by the formula (10) . 

Since the number of the pixels of the two-dimensional , 

25 image display screen 200 is limited, a value of the 

interval (xp) is finite. The shift of the visual region 
can be made identical to the interval in which the parallax 
information is presented (xp = xs) under this condition. 
In other words, the visual region can be made to follow 

30 perfectly smoothly in the system. 

As described above, the shift of the viewing zone in 
the horizontal direction, in which the minimum unit of 
which is smaller than that in the shift in the vertical 
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direction, is realized with the vertical shift of the 
elemental image array. Then, the shift direction 
determining unit 132 determines whether. the elemental image 
array is shifted in the horizontal direction or in the 
5 vertical direction, according to the shift amount 

determined by the shift amount determining unit 130. 

When the longitudinal axis 302 is inclined so as to 
form a downward slope as in the optical plate 300 according 
to this embodiment, in other words, when the inclination 

10 degree 0 of the longitudinal axis 302 satisfies -45° < 0 < 
0°, the elemental image array may be shifted downward from 
top to bottom of the two-dimensional image display screen 
200, in order to shift the elemental image array from a 
right side to a left side of the two-dimensional image 

15 display screen 200 seen from an observer side. Further, 

the elemental image array may be upward shifted from below 
the two-dimensional image display screen 200, in order to 
shift the elemental image array from the left side to the 
right side. 

20 Further as another example, when the longitudinal axis 

302 of the optical plate 300 slopes down to left, in other 
words, when the inclination degree 0 of the longitudinal 
axis 302 satisfies 0° < 0 < 45°, the elemental image array 
may be shifted upward from the bottom to the top, in order 

25 to shift the elemental image array from right side to left 
side. In order to shift the elemental image array from the 
left side to the right side, the elemental image array may 
be shifted from the top to the bottom. 

Meanwhile, along with the shift of the elemental image 

30 array, the three-dimensional image itself is shifted 

upwards or downwards. However, since the shift amount is 
product of pixel pitch and shift amount, shift of the 
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three-dimensional image in the vertical direction is as 
small as 517.5 (jm (=xsp x 3 x 3) , for example, even when 
the elemental image array is shifted by three pixels as 
shown in FIG. 11, and hence, the vertical shift of the 
5 three-dimensional image does not become problematic. 

When the shift amount is equal to or larger than this, 
the shift in the vertical direction may be increased. 
Alternatively, the shift in the horizontal direction may be 
combined. The shift by one pixel in the horizontal 

10 direction equals to the shift by four pixels in the 

vertical direction. Hence, when the shift amount is equal 
to or larger than one pixel in the horizontal direction, 
the shift in the horizontal direction is combined. Thereby, 
it becomes possible to narrow a surplus portion generated 

15 by the shift of the elemental image array. Herein, the 
surplus portion is intended to mean the pixel region to 
which the parallax information is not assigned as a result 
of the shift of the elemental image array. For example, in 
FIG. 12, a region 420 is the surplus portion. 

20 Further, by combining the shifts in the horizontal 

direction and in the vertical direction in this manner, it 
becomes possible to minimize the displacement of the 
display position of the three-dimensional image caused by 
the shift of the elemental image array. 

25 FIG. 4 is described again. The elemental image array 

shifting unit 134 shifts the elemental image array by the 
shift amount determined by the shift amount determining 
unit 130 in the shift direction determined by the shift 
direction determining unit 132. The surplus portion 

30 processing unit 140 assigns an appropriate image to the 

surplus portion generated after shifting by the elemental 
image array shifting unit ,134 . Specifically, the elemental 
image array disposed before the shifting is assigned. 
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Alternatively, an image to be assigned to the surplus 
portion may be held in advance and assigned. A black image, 
for example, may be used as such an image. 

As described above, the parallax information is the 
5 information, the size of which is larger than the screen 
size of the two-dimensional image display screen 200. In 
order to minimize the surplus portion generated at the 
shifting of the elemental image array, the information, the 
size of which is larger than the screen size of the two- 

10 dimensional image display screen 200, is generated. In 

this manner, since the size of the parallax information is 
larger than the screen size of the two-dimensional image 
display screen 200, the surplus portion may be minimized, 
and the three-dimensional image can be displayed with 

15 accuracy even when the elemental image array is shifted. 

FIG. 13 is a flowchart of a position displacement 
correction process by the three-dimensional image display 
device 10 according to the first embodiment. The parallax 
information disposing unit 110 determines a disposing 

20 position of the parallax information based on the device 

information held by the device information holding unit 104 
(step S100) . Next, the parallax information disposing unit 
110 disposes the parallax information held by the parallax 
information holding unit 102 on the determined disposing 

25 position (step S102) . 

Next, the shift amount determining unit 130 determines 
the shift amount based on the viewing position displacement 
amount detected by the viewing position displacement 
detecting unit 120 and the adjustment value held by the 

30 adjustment information holding unit 122 (step S104) . Then, 
the shift direction determining unit 132 determines the 
shift direction based on the shift amount determined by the 
device information holding unit 104 (step S106) . Further, 
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the elemental image array shifting unit 134 shifts the 
elemental image array (step S108) . Further, the parallax 
information disposing unit 110 assigns an appropriate image 
to the surplus portion generated by the shift (step S110) . 
5 Herewith, the position displacement correction process ends. 
The above-described position displacement correction 
process may be performed at the fabrication of the three- 
dimensional image display device 10, or after the shipment 
of the same by instruction of the user. 

10 First, a correction process of the viewing position 

displacement is described. When the observer moves to the 
y-direction, it is possible to make the viewing zone move 
to the position where the observer moves, by making the 
viewing zone shift in the x-direction. 

15 FIG. 14 illustrates the shift of the viewing zone in 

accordance with the move of the observer in the y-direction. 
As shown in FIG . 14, when the observer observes the three- 
dimensional image in an observing direction (1), that is, 
the z-direction, which is a normal line direction of the 

20 two-dimensional image display screen 200, the pixels on a 
viewing position (1) are observed. If the observing 
direction moves to directions (2) and (3) , the viewing 
positions are accordingly shifted to positions (2) and (3) , 
respectively. 

25 Thus, when the y coordinate of the observer shifts, 

the position of the parallax information relative to the 
exit pupil, or the position of the exit pupil relative to 
the parallax information relatively moves in the x- 
direction. In other words, when the observer moves to the 

30 y-direction, the viewing zone is shifted to the x-direction. 

The shift of the viewing zone along with the move of 
the observer in the y-direction is especially noticeable 
when a horizontal parallax type three-dimensional image 
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display device is set such that a display surface thereof 
is horizontal, i.e., when the device is used as a flatbed 
display device. 

FIG. 15 shows a three-dimensional image display device 
5 10 of a flatbed type. As shown in the drawing, in the case 
of the flatbed-type three-dimensional image display device 
10, the observer looks down the screen of the three- 
dimensional image display device 10 from above. Hence, the 
y coordinate of the viewing position is affected by the 

10 position and the sitting height of the observer. Therefore, 
the viewing position easily varies as compared to that of 
the vertically set display device. 

The three-dimensional image display device 10 
according to the first embodiment can deal with such 

15 variation in the viewing position with high accuracy. 

This will be described more specifically. When the 
viewing position moves in the y-direction (displacement 
amount: yl) , the shift amount xs of the viewing zone in the 
horizontal direction is represented by a formula (12) : 

20 xs = b x L/g < 12 > 

Herein, b is a value of a horizontal displacement width in 
a single pixel row of the two-dimensional image display 
device observed through a single exit pupil when the 
viewing position moves in the y-direction, and is 

25 represented by a formula (13) : 



Further, "a" represents an interval width between a 
slit position and the viewing position, and is represented 
by a formula (14) : 



b = a x tan 0 



(13) 



30 



a = g/tan 

Herein, tan<J> . is defined by a following formula (15): 



(14) 



tan <|> - 



L/yl 



(15) 
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Thus, the formula (12) is transformed as a formula (16) : 
xs « b x L/g 

= (g/tan $) x tan § x L/g 

= tan 0 x L/tan <|> (16) 
5 Therefore, if the above-described horizontal parallax 

type three-dimensional image display device is horizontally 
set as a flatbed display and observed with angle of 
depression of 45°, the viewing zone is shifted no less than 
100 mm in the horizontal direction as compared to a case 
10 where the device is observed from front (with angle of 
depression of 90°) . 

If the parallax number is set to N (N=16, in the first 
embodiment), the viewing zone (VW) is represented by a 
formula (17) : 

15 VW = N x 3/4 x xsp x L/g (17) 

Therefore, under the condition of the first embodiment, 
VW = 206.89 mm. Further, the interval (xp) in which the 
parallax information is presented is 12.93 mm as described 
above . 

20 So, if the viewing zone is shifted by 100 mm, this is 

equivalent that the viewing zone is shifted approximately 
halfway. In other words, if the image, which is set on the 
assumption that the angle of depression is 45°, is observed 
from right above the display by the observer who leans over 

25 the display, the position of the head of the observer is on 
the edge of the visual region. 

Further, if the y coordinate of ' the observer (L = 400 
mm) moves as short as 4 cm, the viewing zone is shifted by 
10 mm, i.e., approximately one parallax in the horizontal 

30 direction. This indicates that positioning of the lens 
while assuming the angle of depression is difficult. 
The three-dimensional image display device 10 
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according to the first embodiment can solve the above- 
described problem. As already described, the three- 
dimensional image display device 10 according to the, first 
embodiment can shift the viewing zone with a minimum unit 
5 of 12 . 93 mm. 

Therefore, if the observer moves from the position 

with the angle of depression of 45° to the position with 
the angle of depression of 90° , the viewing zone may be 
shifted by one to eight pixels in the vertical direction, 

10 in accordance with the move. Further, when the region is 

shifted by four pixels or more, the shift in the horizontal 
direction can be combined. 

The positioning of the two-dimensional image display 
screen 200 and the optical plate 300 is performed in the 

15 fabricating process. When the optical plate 300 is 

attached to the two-dimensional image display screen 200, 
displacement of an attaching position, that is, the 
displacement of the optical plate becomes problematic. The 
alignment of the two-dimensional image display screen 200 

20 and the optical plate 300 affects the viewing zone of the 
three-dimensional image display device 10, and hence 
sufficient accuracy is required. 

In the horizontal parallax system, there is a case 
where the parallax information is disposed by sub-pixel 

25 pitch of a FPD, in order to increase the horizontal 

parallax number. In this case, the parallax information is 
shifted by one with a shift by the sub-pixel width 
(approximately 50 ^im) . If the exit pupil is inclined from 
the vertical direction, it is required to assume the angle 

30 of depression, that is, the y coordinate, when setting the 
viewing zone, which makes the positioning even more 
difficult. 
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The three-dimensional image display device 10 can 
correct the viewing zone according to such displacement of 
the optical plate 300. Specifically, if the user inputs 
such an optical plate displacement amount, the adjustment 
5 information obtaining unit 124 obtains the optical plate 
displacement amount as the adjustment information, and 
holds the same. Further, the three-dimensional image, 
display device 10 shifts the elemental image array 
according to the optical plate displacement amount, and 
10 sets a disposing position after the shift as a default 

value. Thereby, the displacement of the optical plate 300 
can be compensated. In brief, yield ratio can be improved 
by recovery . 

Further, in the fabricating process, the optical plate 

15 300 is attached by observing from a normal line direction 
of the two-dimensional image display screen 200, and after 
that, the angle of depression (ty) is measured. Further by 
an input of the angle of depression by the user, the 
adjustment information holding unit 122 obtains the angle 

20 of depression input by the user through the adjustment 

information obtaining unit 124, and holds the same. The 
elemental image 410 may be shifted according to the held 
angle of depression, and the disposing position after the 
shift may be set as the default value. Thereby, a device 

25 can be manufactured irrespective of type of usage. 

Further, there is a case where the user wants to use 
the three-dimensional image display device 10 in both 
vertical and horizontal setting. In this case, the three- 
dimensional image display device 10 can correct the visual 

30 region according to the displacement amount generated from 
the inclination degree of the three-dimensional image 
display device 10 itself.. Specifically, the inclination 
degree of the three-dimensional image display device 10 is 
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obtained by the input of the user. Further, by shifting 
the elemental image 410 according to the setting degree, an 
appropriate three-dimensional image can be displayed for 
each type of usage. 
5 Further, there is a case where the optical plate 

displacement is generated according to the change over time 
after fabrication. For example, such displacement could be 
generated by an environment or a physical shock after the 
shipment. In this case, the three-dimensional image 

10 display device 10 can adjust the disposing position 
according to the optical plate displacement amount. 

The three-dimensional image display device 10 holds an 
image for adjustment, which is used at the correction of 
such optical plate displacement, to perform a displacement 

15 correction process using this image. Hereinbelow, a case 

with an integral imaging system will be described. FIG. 16 
illustrates the displacement correction process in the 
integral imaging system. 

When horizontal pitch of the exit pupil is set to 

20 integral multiple of the sub-pixel pitch, rays which exit 
from the pixels having the same parallax number (camera 
number) are in a substantially parallel relationship, as 
shown in Fig. 16. 

For example, suppose that only the sub-pixels, on 

25 which the first parallax information is disposed in FIG. 5, 
are illuminated and others are not illuminated. When the 
display is observed in this state from a viewing position 
.530 away from the display by a distance L, with one eye, 
emission lines extending in the vertical direction with 

30 constant intervals, are observed. 

If the interval is set to xt, a horizontal interval 
between the pixels on which the first parallax information 
is disposed is set to pi, and an interval between the 
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pixels on which the first parallax information 
simultaneously seen by one eye is disposed is set to pii, 
formulae (18) to (20) are obtained: 

pi = xsp x N x 3/n (18) 
5 pii - pi x (xt/pi + 1) (19) 

pii = (L + g) /L x xt (20) 
By assigning the previously described formulae into the 
formulae (18) to (20) , a formula (21) can be obtained: 

xt = pii - pi 

10 = 3 x xsp x N/n/((L + g) /L - 1) (21) 

When the previously described conditions are assigned 
into the formula (21), xt = 206.9 mm. That is, the 
emission lines are visually recognized as vertical stripes 
with intervals of approximately slightly above 20 cm. The 

15 display positions of the emission lines are uniquely 
determined according to the. relation between the 
illuminated parallax information and the position of the 
optical plate 300. Therefore, by making the image for • 
adjustment and the display position (x coordinate) of the 

20 emission line correspond to each other, it becomes possible 
to confirm the optical plate displacement by visually 
recognizing the position displacement and the inclination 
'of the emission lines. 

For example, if the optical plate position is shifted 

25 by one sub-pixel in the x-direction, the position of the 
emission line is shifted by xs represented by a formula 
(22) : 

xs = xsp x L/g (22) 
When the elemental image 410 is disposed as shown in 
30 FIG. 5, when the emission line is shifted by xf in the x- 
direction, the elemental image array may be shifted 
downward by (xf/xs) rows. 
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When mounting the same, for example, a key to 
sequentially shift the elemental image array upward or 
downward (horizontally) , in a condition in which the user 
. is on the viewing position, is provided, and makes the user 
5 adjust by pressing the key until the emission lines have 
desired intervals. 

An ideal display position of the emission lines may be 
presented by a document or the like, or presented in some 
way outside the display region for the three-dimensional 

10 image (for example, a casing) of the three-dimensional 
image display device. 

Furthermore, the elemental image array including an 
image for positioning can be prepared by dividing the 
elemental image array in two portions in the vertical 

15 direction. An image for adjustment (A) is displayed on one 
of the two portions. Further, a guide image (B) indicating 
the x coordinate on which the emission lines should be 
displayed is displayed on the other portion. The guide 
image may be in a condition in which all the elemental 

20 images corresponding to the exit pupils relevant to the x 

coordinate on which the emission lines are to be indicated, 
are illuminated. 

When all the corresponding elemental images are 
illuminated, the elemental images in a certain range 

25 (=viewing zone) are sequentially seen illuminated. 

Therefore, even if the position of the exit pupil is 
shifted a little, if this is not shifted halfway the 
elemental image width or more, these elemental images are 
always seen illuminated, when this is observed by one eye 

30 in the viewing zone.. In such a condition, an entire image 
(A+B) including the elemental image array is shifted up and 
down, and to the right an£ the left, thereby making the x 
coordinate of the lens which illuminates in a (B) range and 
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the x coordinate of the lens which illuminates in a (A) 
range substantially conform to each other. 

Next, a case of multi lens system is described. FIG. 
17 illustrates a position displacement correction process 
5 in a multi lens system. Horizontal pitch of the exit pupil 
of the multi lens system is set to L/ (L + g) , which is an 
integral multiple of the sub-pixel pitch. Consequently, as 
shown in FIG. 17 , rays exit from the pixels on which the 
identical parallax information is disposed are focused on a 

10 position 540 with a visual distance L. 

For example, suppose that only the sub-pixels on which 
the first parallax information is disposed, which are 
disposed as shown in FIG. 5 are illuminated and others are 
not illuminated. In this case, if the image is observed by 

15 one eye from the distance L, the image is observed such 

that the entire image is illuminated. However, if this is 
observed from a point off from a designed visual distance L, 
a range of illuminated pixels is narrowed (only the pixels 
directly in front of the observer are seen illuminated) . 

20 In other words, when the image is observed from a position 
slightly off from the visual distance L, the inclination of 
the optical plate 300 can be confirmed. For example, if 
the optical plate 300 is attached to the two-dimensional 
image display screen 200 as to be inclined relative to the 

25 two-dimensional image display screen 200, the illuminated 
region observed from a position off from the visual 
distance L is also inclined. Further, when an attaching 
position of the optical plate 300 is shifted in the x- 
direction, the entire image is seen not illuminated. 

30 Therefore, when the user is made to operate the key to 

shift the elemental image array in up-and-down (horizontal) 
direction to illuminate the entire image, displacement of 
the lens position may be compensated by up-and-down 



WO 2007/037034 



PCT/JP2006/309189 



33 

(vertical) shift of the elemental image array. 

FIG. 18 is a block diagram of a hardware structure of 
the display image processing unit 100. The display image 
processing unit 100 is provided with a read only memory 
5 (ROM) 52 that stores the displacement correction program 
for executing the displacement correction process in the 
three-dimensional image display device 10, or the like, a 
central processing unit (CPU) 51 that controls each unit of 
the three-dimensional image display device 10 according to 

10 the program in the ROM 52, a random access memory (RAM) 53 
that stores various data required for controlling the 
three-dimensional image display device 10, a communication 
interface (I/F) 57 that communicates by connecting to a 
network, and a bus 62 that connects respective units with 

15 each other, as the hardware structure. 

The above-described displacement correction program in 
the display image processing unit 100 may be stored in a 
computer-readable recording medium, such as a compact disc 
read only memory (CD-ROM) , a Floppy (Registered trademark) 

20 Disk (FD) , a digital versatile disk (DVD) or the like, as 
an installable or an executable file, and provided. 

In this case, the displacement correction program is 
read out from the above-described recording medium and 
executed by the display image processing unit 100 to be 

25 loaded on a main memory, and each of the units explained in 
the above-described software structure is generated on the 
main memory. 

Further, the displacement correction program of the 
first embodiment may be configured to be stored on the 
30 computer connected to a network such as the Internet or the 
like, and to be provided by being downloaded through the 
network. 

While the present invention has been explained in 
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connection with the embodiment, various modifications and 
improvements can be made to the above-described embodiment. 

FIG. 19 is a view showing a three-dimensional image 
display device 20 according to a second embodiment. A 
5 three-dimensional image display device 20 according to the 
second embodiment is a portable type, The three- 
dimensional image display device 10 according to the second 
embodiment includes an inclination detecting unit 210. 
As a usage pattern of the portable type three- 

10 dimensional image display device 20, it is envisaged that 
the user holds the same in his/her hand and observes the 
three-dimensional image displayed on the three-dimensional 
image display device 20. In this case, the viewing zone is 
shifted according to a relative angle between the three- 

15 dimensional image display device 20 and the viewing 
position. 

When the user holds the three-dimensional image 
display device 20 in his/her hand, the relative angle may 
continually vary. Then, in addition to detection of the 

20 viewing position of the user, an inclination of the three- 
dimensional image display device 20 itself is. detected. 
Further, according to the result of detection, a relative 
position displacement and a degree of the displacement of 
the observer relative to the two-dimensional image display 

25 screen 200 is detected. 

Other structure and process of the three-dimensional 
image display device 20 according to the second embodiment 
are similar to those of the three-dimensional image display 
device 10 according to the first embodiment. 

30 Additional advantages and modifications will readily 

occur to those skilled in the art. Therefore?, the 
invention in its broader aspects is not limited to the 
specific details and representative embodiments shown and 
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described herein. Accordingly, various modifications may 
be made without departing from the spirit or scope of the 
general inventive concept as defined by the appended claims 
and their equivalents. 



